Lifetime Behavior and its Impact on Web Caching

The exponential growth of the World Wide Web has made it the most popular information dissemination tool in the world. The growth necessitates caching, prefetching, and replication schemes on the web to alleviate the web server load, conserve the network band-width, and reduce the retrieval latency. At the same time, cache consistency should be maintained to avoid returning stale pages to users. The study on the characteristics of web documents helps to determine which schemes to be adopted in a speciic web environment. This paper presents characterization of web documents based on their types and environment classes. Nine web server traces are used in this paper, and represent three diierent classes of web environments: educational , commercial and news. Results indicate significant diierences in static as well as dynamic characteristics of documents types in diierent web site classes. The eeciency of caching can be improved if caching priorities and TTL preferences be given to certain types of web documents. We also provide guidelines for the design and development of caching and prefetching techniques that can exploit the web document characteristics in diierent environments.